Trainee advocacy for medical education on the care of people with intellectual and/or developmental disabilities: a sequential mixed methods analysis.

BACKGROUND: Medical trainees (medical students, residents, and fellows) are playing an active role in the development of new curricular initiatives; however, examinations of their advocacy efforts are rarely reported. The purpose of this study was to understand the experiences of trainees advocating for improved medical education on the care of people with intellectual and/or developmental disabilities. METHODS: In 2022-23, the authors conducted an explanatory, sequential, mixed methods study using a constructivist paradigm to analyze the experiences of trainee advocates. They used descriptive statistics to analyze quantitative data collected through surveys. Participant interviews then yielded qualitative data that they examined using team-based deductive and inductive thematic analysis. The authors applied Kern's six-step approach to curriculum development as a framework for analyzing and reporting results. RESULTS: A total of 24 participants completed the surveys, of whom 12 volunteered to be interviewed. Most survey participants were medical students who reported successful advocacy efforts despite administrative challenges. Several themes were identified that mapped to Steps 2, 4, and 5 of the Kern framework: "Utilizing Trainee Feedback" related to Needs Assessment of Targeted Learners (Kern Step 2); "Inclusion" related to Educational Strategies (Kern Step 4); and "Obstacles", "Catalysts", and "Sustainability" related to Curriculum Implementation (Kern Step 5). CONCLUSIONS: Trainee advocates are influencing the development and implementation of medical education related to the care of people with intellectual and/or developmental disabilities. Their successes are influenced by engaged mentors, patient partners, and receptive institutions and their experiences provide a novel insight into the process of trainee-driven curriculum advocacy.

Better together: A multistakeholder approach to developing specialty-wide entrustable professional activities in emergency medicine.

Purpose: Entrustable professional activities (EPAs) are a widely used framework for curriculum and assessment, yet the variability in emergency medicine (EM) training programs mandates the development of EPAs that meet the needs of the specialty as a whole. This requires eliciting and incorporating the perspectives of multiple stakeholders (i.e., faculty, residents, and patients) in the development of EPAs. Without a shared understanding of what a resident must be able to do upon graduation, we run the risk of advancing ill-prepared residents that may provide inconsistent care. Methods: In an effort to address these challenges, beginning in February 2020, the authors assembled an advisory board of 25 EM faculty to draft and reach consensus on a final list of EPAs that can be used across all training programs within the specialty of EM. Using modified Delphi methodology, the authors came to consensus on an initial list of 22 EPAs. The authors presented these EPAs to faculty supervisors, residents, and patients for refinement. The authors collated and analyzed feedback from focus groups of residents and patients using thematic analysis. The EPAs were subsequently refined based on this feedback. Results: Stakeholders in EM residency training endorsed a final revised list of 22 EPAs. Stakeholder focus groups highlighted two main thematic considerations that helped shape the finalized list of EM EPAs: attention to the meaningful nuances of EPA language and contextualizing the EPAs and viewing them developmentally. Conclusions: To foreground all key stakeholders within the EPA process for EM, the authors chose within the development process to draft; come to consensus; and refine EPAs for EM in collaboration with relevant faculty, patient, and resident stakeholders. Each stakeholder group contributed meaningfully to the content and intended implementation of the EPAs. This process may serve as a model for others in developing stakeholder-responsive EPAs.

What the experts see: A qualitative analysis of the behaviors of master adaptive learners in emergency medicine.

Objectives: The Master Adaptive Learner (MAL) model postulates that learners develop adaptive expertise through cycles of self-regulated learning. Despite a robust theoretical basis, the actual observable behaviors of MALs are not well characterized. We sought to define behaviors that characterize MALs within emergency medicine (EM) training. Methods: Using a constructivist grounded theory approach, we analyzed semistructured interviews with expert EM educators. These experts reflected on observable behaviors as well as factors in the clinical learning environment that may modulate these behaviors. We recruited using purposive sampling until thematic saturation. Results: We identified four overall themes, of which three described groups of learner behaviors and a fourth described modifiers of these behaviors. Learner behaviors include: (1) critical interrogation of practice, (2) intellectual risk-taking, and (3) intentional curation of a learning network. Critical interrogation of practice encompasses several observable behaviors including learner-driven feedback conversations, independent synthesis of clinical information, appropriate deviation from algorithms based on their conceptual understanding of core principles, intentional use of case variation and hypothetical questioning, and continuous refinement of decisions. MALs also engage in intellectual risk-taking for their development by communicating clinical decision-making processes even at the risk of being wrong, openly addressing errors and gaps, and intentionally seeking out uncomfortable experiences. Intentional curation of a learning network is the deliberate development of a consortium of trusted individuals who serve as mentors and sounding boards. We also identified a fourth theme related to the expression of learner behaviors: learning environment modulates behaviors. Active promotion of psychological safety is necessary for learners to express these behaviors. This safety is mediated through trusting relationships and expert supervisors who serve as colearners and role models. Conclusions: We present several behaviors that allow identification of MALs among EM trainees. These data expand our understanding of MALs and the critical influence of the learning environment. Identification of these behaviors may allow for more precise categorization of targeted curricular interventions and meaningful learning outcomes.

Training for Adaptive Expertise: Why, What, and How.

BACKGROUND: Routine expertise is the efficient use of mastered skills at a high level of competency in familiar situations. PROBLEM: Novel case variation and continuous scientific advances preclude reliance on routine expertise alone. SOLUTION: Medical training programs must prepare learners to solve unfamiliar problems by cultivating adaptive expertise. Adaptive expertise is the ability to transfer existing knowledge to innovate a solution for an unfamiliar problem.

A Conference (Missingness in Action) to Address Missingness in Data and AI in Health Care: Qualitative Thematic Analysis.

BACKGROUND: Missingness in health care data poses significant challenges in the development and implementation of artificial intelligence (AI) and machine learning solutions. Identifying and addressing these challenges is critical to ensuring the continued growth and accuracy of these models as well as their equitable and effective use in health care settings. OBJECTIVE: This study aims to explore the challenges, opportunities, and potential solutions related to missingness in health care data for AI applications through the conduct of a digital conference and thematic analysis of conference proceedings. METHODS: A digital conference was held in September 2022, attracting 861 registered participants, with 164 (19%) attending the live event. The conference featured presentations and panel discussions by experts in AI, machine learning, and health care. Transcripts of the event were analyzed using the stepwise framework of Braun and Clark to identify key themes related to missingness in health care data. RESULTS: Three principal themes-data quality and bias, human input in model development, and trust and privacy-emerged from the analysis. Topics included the accuracy of predictive models, lack of inclusion of underrepresented communities, partnership with physicians and other populations, challenges with sensitive health care data, and fostering trust with patients and the health care community. CONCLUSIONS: Addressing the challenges of data quality, human input, and trust is vital when devising and using machine learning algorithms in health care. Recommendations include expanding data collection efforts to reduce gaps and biases, involving medical professionals in the development and implementation of AI models, and developing clear ethical guidelines to safeguard patient privacy. Further research and ongoing discussions are needed to ensure these conclusions remain relevant as health care and AI continue to evolve.

How are students learning to care for people with disabilities?: exploring the curriculum design of a sample of disability electives offered by US health professions schools.

PURPOSE: There is an increased demand among health professions students for disability-focused training. We aimed to characterize the development and structure of a sample of disability electives offered at health professions schools in the United States. MATERIALS AND METHODS: A survey was developed to capture data on the curriculum design of disability electives offered at health professions schools across the United States. The primary outcome measures were elective development, elective structure, learner and instructor demographics, disability inclusion, and evaluation methodologies. A cross-sectional survey study was conducted, during which the survey was distributed to relevant professional societies focused on disability advocacy within healthcare. RESULTS: Data were collected on fifteen disability electives. Most electives were developed within the past four years, and many electives were initiated by students. The structure, duration, and evaluation methodology of electives were highly variable. Most electives took the form of a longer didactic-based course or a shorter clinical experience. All electives involved people with disabilities in some capacity. CONCLUSIONS: Disability electives fill an important gap in disability education at some health professions schools. Elective directors should have an increased focus on assessing student learning and ensuring that people with disabilities are involved in elective design and instruction.

Many healthcare professionals do not feel confident in caring for people with disabilities, and a lack of disability-specific training is likely contributing to this lack of confidence.Disability electives fill an important gap in disability-specific training at some health professions schools.Future research should focus on content standardization, assessment of student learning, and ensuring that people with disabilities are involved in elective design and instruction.An improved understanding of disability electives will assist with the development of future disability-related training for health professions students.

Characteristics of Emergency Medicine Residency Programs With Unfilled Positions in the 2023 Match.

STUDY OBJECTIVE: The unprecedented number of unfilled emergency medicine post-graduate year 1 (PGY-1) residency positions in the 2023 National Resident Matching Program shocked the emergency medicine community. This study investigates the association between emergency medicine program characteristics and the likelihood of unfilled positions in the 2023 Match. METHODS: This cross-sectional, observational study examined 2023 National Resident Matching Program data, focusing on program type, length, location, size, proximity to other programs, previous American Osteopathic Association (AOA) accreditation, first accreditation year, and emergency department ownership structure. We constructed a generalized linear mixed model with a logistic linking function to determine predictors of unfilled positions. RESULTS: A total of 554 of 3,010 (18.4%) PGY-1 positions at 131 of 276 (47%) emergency medicine programs went unfilled in the 2023 Match. In our model, predictors included having unfilled positions in the 2022 Match (odds ratio [OR] 48.14, 95% confidence interval [CI] 21.04 to 110.15), smaller program size (less than 8 residents, OR 18.39, 95% CI 3.90 to 86.66; 8 to 10 residents, OR 6.29, 95% CI 1.50 to 26.28; 11 to 13 residents, OR 5.88, 95% CI 1.55 to 22.32), located in the Mid Atlantic (OR 14.03, 95% CI 2.56 to 77.04) area, prior AOA accreditation (OR 10.13, 95% CI 2.82 to 36.36), located in the East North Central (OR 6.94, 95% CI 1.25 to 38.47) area, and corporate ownership structure (OR 3.21, 95% CI 1.06 to 9.72). CONCLUSION: Our study identified 6 characteristics associated with unfilled emergency medicine residency positions in the 2023 Match. These findings may be used to guide student advising and inform decisions by residency programs, hospitals, and national organizations to address the complexities of residency recruitment and implications for the emergency medicine workforce.

Teaching LGBTQ+ Health, a Web-Based Faculty Development Course: Program Evaluation Study Using the RE-AIM Framework.

BACKGROUND: Many health professions faculty members lack training on fundamental lesbian, gay, bisexual, transgender, and queer (LGBTQ+) health topics. Faculty development is needed to address knowledge gaps, improve teaching, and prepare students to competently care for the growing LGBTQ+ population. OBJECTIVE: We conducted a program evaluation of the massive open online course Teaching LGBTQ+ Health: A Faculty Development Course for Health Professions Educators from the Stanford School of Medicine. Our goal was to understand participant demographics, impact, and ongoing maintenance needs to inform decisions about updating the course. METHODS: We evaluated the course for the period from March 27, 2021, to February 24, 2023, guided by the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework. We assessed impact using participation numbers, evidence of learning, and likelihood of practice change. Data included participant demographics, performance on a pre- and postcourse quiz, open-text entries throughout the course, continuing medical education (CME) credits awarded, and CME course evaluations. We analyzed demographics using descriptive statistics and pre- and postcourse quiz scores using a paired 2-tailed t test. We conducted a qualitative thematic analysis of open-text responses to prompts within the course and CME evaluation questions. RESULTS: Results were reported using the 5 framework domains. Regarding Reach, 1782 learners participated in the course, and 1516 (85.07%) accessed it through a main course website. Of the different types of participants, most were physicians (423/1516, 27.9%) and from outside the sponsoring institution and target audience (1452/1516, 95.78%). Regarding Effectiveness, the median change in test scores for the 38.1% (679/1782) of participants who completed both the pre- and postcourse tests was 3 out of 10 points, or a 30% improvement (P<.001). Themes identified from CME evaluations included LGBTQ+ health as a distinct domain, inclusivity in practices, and teaching LGBTQ+ health strategies. A minority of participants (237/1782, 13.3%) earned CME credits. Regarding Adoption, themes identified among responses to prompts in the course included LGBTQ+ health concepts and instructional strategies. Most participants strongly agreed with numerous positive statements about the course content, presentation, and likelihood of practice change. Regarding Implementation, the course cost US $57,000 to build and was intramurally funded through grants and subsidies. The course faculty spent an estimated 600 hours on the project, and educational technologists spent another 712 hours. Regarding Maintenance, much of the course is evergreen, and ongoing oversight and quality assurance require minimal faculty time. New content will likely include modules on transgender health and gender-affirming care. CONCLUSIONS: Teaching LGBTQ+ Health improved participants' knowledge of fundamental queer health topics. Overall participation has been modest to date. Most participants indicated an intention to change clinical or teaching practices. Maintenance costs are minimal. The web-based course will continue to be offered, and new content will likely be added.

The role of emergency physicians in the fight against health misinformation: Implications for resident training.

Emergency physicians on the frontlines of the COVID-19 pandemic are first-hand witnesses to the direct impact of health misinformation and disinformation on individual patients, communities, and public health at large. Therefore, emergency physicians naturally have a crucial role to play to steward factual information and combat health misinformation. Unfortunately, most physicians lack the communications and social media training needed to address health misinformation with patients and online, highlighting an obvious gap in emergency medicine training. We convened an expert panel of academic emergency physicians who have taught and conducted research about health misinformation at the Society for Academic Emergency Medicine (SAEM) Annual Meeting in New Orleans, LA, on May 13, 2022. The panelists represented geographically diverse institutions including Baystate Medical Center/Tufts University, Boston Medical Center, Northwestern University, Rush Medical College, and Stanford University. In this article, we describe the scope and impact of health misinformation, introduce methods for addressing misinformation in the clinical environment and online, acknowledge the challenges of tackling misinformation from our physician colleagues, demonstrate strategies for debunking and prebunking, and highlight implications for education and training in emergency medicine. Finally, we discuss several actionable interventions that define the role of the emergency physician in the management of health misinformation.

Patient handoffs and multi-specialty trainee perspectives across an institution: informing recommendations for health systems and an expanded conceptual framework for handoffs.

BACKGROUND: Safe and effective physician-to-physician patient handoffs are integral to patient safety. Unfortunately, poor handoffs continue to be a major cause of medical errors. Developing a better understanding of challenges faced by health care providers is critical to address this continued patient safety threat. This study addresses the gap in the literature exploring broad, cross-specialty trainee perspectives around handoffs and provides a set of trainee-informed recommendations for both training programs and institutions. METHODS: Using a constructivist paradigm, the authors conducted a concurrent/embedded mixed method study to investigate trainees' experiences with patient handoffs across Stanford University Hospital, a large academic medical center. The authors designed and administered a survey instrument including Likert-style and open-ended questions to solicit information about trainee experiences from multiple specialties. The authors performed a thematic analysis of open-ended responses. RESULTS: 687/1138 (60.4%) of residents and fellows responded to the survey, representing 46 training programs and over 30 specialties. There was wide variability in handoff content and process, most notably code status not being consistently mentioned a third of the time for patients who were not full code. Supervision and feedback about handoffs were inconsistently provided. Trainees identified multiple health-systems level issues that complicated handoffs and suggested solutions to these threats. Our thematic analysis identified five important aspects of handoffs: (1) handoff elements, (2) health-systems-level factors, (3) impact of the handoff, (4) agency (duty), and (5) blame and shame. CONCLUSIONS: Health systems, interpersonal, and intrapersonal issues affect handoff communication. The authors propose an expanded theoretical framework for effective patient handoffs and provide a set of trainee-informed recommendations for training programs and sponsoring institutions. Cultural and health-systems issues must be prioritized and addressed, as an undercurrent of blame and shame permeates the clinical environment.

Child-focused climate change and health content in medical schools and pediatric residencies.

Anthropogenic climate change-driven primarily by the combustion of fossil fuels that form greenhouse gases-has numerous consequences that impact health, including extreme weather events of accelerating frequency and intensity (e.g., wildfires, thunderstorms, droughts, and heat waves), mental health sequelae of displacement from these events, and the increase in aeroallergens and other pollutants. Children are especially vulnerable to climate-related exposures given that they are still developing, encounter higher exposures compared to adults, and are at risk of losing many healthy future years of life. In order to better meet the needs of generations of children born into a world affected by climate change, medical trainees must develop their knowledge of the relationships between climate change and children's health-with a focus on applying that information in clinical practice. This review provides an overview of salient climate change and children's health topics that medical school and pediatric residency training curricula should cover. In addition, it highlights the strengths and limitations of existing medical school and residency climate change and pediatric health curricula. IMPACT: Provides insight into the current climate change and pediatric health curricular opportunities for medical trainees in North America at both the medical school and residency levels. Condenses climate change and pediatric health material relevant to trainees to help readers optimize curricula at their institutions.

Practical tips for navigating a program director transition.

Residency and fellowship program directors profoundly impact trainees, institutions, and patient safety. Yet, there is concern for rapid attrition in the role. The average program director tenure is only 4-7 years, and that timeline is likely a result of burnout or opportunities for career advancement. Program director transitions must be carefully executed to ensure minimal disruption to the program. Transitions benefit from clear communication with trainees and other stakeholders, well-planned successions or searches for a replacement, and clearly delineated expectations and responsibilities of the outgoing program director. In this Practical Tips, four former residency program directors offer a roadmap for a successful program director transition, with specific recommendations to guide critical decisions and steps in the process. Themes emphasized include readiness for a transition, communication strategies, alignment of program mission and search efforts, and anticipatory support to ensure the success of the new director.

Digital Impact Factor: A Quality Index for Educational Blogs and Podcasts in Emergency Medicine and Critical Care.

STUDY OBJECTIVE: Given the popularity of educational blogs and podcasts in medicine, learners and educators need tools to identify trusted and impactful sites. The Social Media Index was a multi-sourced formula to rank the effect of emergency medicine and critical care blogs. In 2022, a key data point for the Social Media Index became unavailable. This bibliometric study aimed to develop a new measure, the Digital Impact Factor, as a replacement. METHODS: The Digital Impact Factor incorporated modern measures of website authority and reach. This formula was applied to a cross-sectional study of active emergency medicine and critical care blogs and podcasts. For each website, we generated a Digital Impact Factor score based on Ahrefs Domain Rating and the follower count of the websites' pages from 8 social media platforms. A series of Spearman correlations provided evidence of association by comparing a rank-ordered list to rank lists derived from the Social Media Index over the last 5 years. The Bland-Altman analysis assessed for agreement. RESULTS: The authors identified 88 relevant websites with a median Ahrefs Domain Rating of 28 (range 0 to 71, maximum 100) and total social media followership count across 8 platforms of 1,828,557. The Domain Rating and individual social media followership scores were normalized based on the highest recorded values to yield the Digital Impact Factor (median 4.57; range 0.02 to 9.50, maximum 10). The correlation between the 2022 Digital Impact Factor and the 2021 Social Media Index was 0.94 (95% confidence interval 0.89 to 0.97; p<.001; n=41 rankings correlated), suggesting that they measure similar constructs. The Bland-Altman plot also demonstrated fair agreement between the 2 scores. CONCLUSION: The Digital Impact Factor is a measure of the relative effect of educational blogs and podcasts within emergency medicine and critical care.

Rejecting Reforms, Yet Calling for Change: A Qualitative Analysis of Proposed Reforms to the Residency Application Process.

PURPOSE: Annual increases in the number of residency applications burden students and challenge programs. Several reforms to the application process have been proposed; however, stakeholder input is often overlooked. The authors examined key stakeholders' opinions about several proposed reforms to the residency application process and identified important factors to guide future reforms. METHOD: Using semistructured interviews, the authors asked educational administrators and trainees to consider 5 commonly proposed reforms to the residency application process: Match to obtain residency interviews, preference signaling, application limits, geographic preference disclosure, and abolishing the Match. The authors conducted a modified content analysis of interview transcripts using qualitative and quantitative analytic techniques. Frequency analysis regarding the acceptability of the 5 proposed reforms and thematic analysis of important factors to guide reform were performed. Fifteen-minute interviews were conducted between July and October 2019, with data analysis completed during a 6-month period in 2020 and 2021. RESULTS: Participants included 30 stakeholders from 9 medical specialties and 15 institutions. Most participants wanted to keep the Match process intact; however, they noted several important flaws in the system that disadvantage students and warrant change. Participants did not broadly support any of the 5 proposed reforms. Two themes were identified: principles to guide reform (fairness, transparency, equity, reducing costs to students, reducing total applications, reducing work for program directors, and avoiding unintended consequences) and unpopular reform proposals (concern that application limits threaten less competitive students and signaling adds bias to the system). CONCLUSIONS: Key stakeholders in the residency application process believe the system has important flaws that demand reform. Despite this, the most commonly proposed reforms are unacceptable to these stakeholders because they threaten fairness to students and program workload. These findings call for a larger investigation of proposed reforms with a more nationally representative stakeholder cohort.

Belongingness among first-generation students at Stanford School of Medicine.

Background: Nationally, underrepresented minorities represent a significant proportion of the first-generation student population. These students also tend to report lower levels of belongingness compared to their peers, which may impact their wellness and be an important factor in their academic success. This study aimed to explore whether status as a first-generation student was associated with belongingness amongst medical students. Methods: In 2019, a previously validated 16-item survey was used to examine potential disparities in belongingness amongst groups of first-generation medical students. Differences between groups were assessed using a Mann-Whitney U-test for each individual item and three composite groupings of items regarding social belonging, academic belonging, and institutional support. Results: First-generation to college and first-generation to graduate school students reported lower belongingness across most individual items as well as in all three composite groups. Conclusions: Given that peer relationships and institutional support play an important role in medical student belonging, these findings represent an opportunity to address the specific needs of individuals from underrepresented groups in medicine. Doing so can support the academic and professional success of first-generation students and help close the diversity gap in medicine.

Is it worth it? A qualitative analysis of the impact of medical education fellowships on careers.

Objectives: Medical education fellowships provide training in teaching, assessment, educational program administration, and scholarship. The longitudinal impact of this training is unknown. The objective of this study was to explore the impact of medical education fellowships on the careers of graduates. Methods: The authors performed a qualitative study with a constructivist-interpretivist paradigm using semistructured interviews in 2021. The authors used a purposeful randomized stratified sampling strategy of graduates to ensure diversity of representation (gender, region, fellowship duration, and career stage). Two researchers independently analyzed interview transcriptions using a modified grounded theory approach. Results: The authors interviewed 10 graduates and identified three overarching concepts: motivations for pursuing fellowship, benefits of training, and drivers of career development. Graduates sought training because of their desire for growth and career preparation and at the advice of mentors. Fellowships provided knowledge and skills in a structured learning environment, supported by mentors and a collaborative community. Fellowship training shaped the careers of graduates by increasing their self-efficacy, enhancing their outcome expectations, refining their goals, and influencing their professional identity formation. They acquired expertise that prepared them for jobs, developed credibility, felt competitive in the job market, anticipated successful promotion, reached for greater goals, broadened their educational worldview, and evolved their professional identity as a result of fellowship training. Conclusions: Fellowship training in medical education provides knowledge and skills, a structured learning environment, and important relationships that shape the careers of graduates by impacting their self-efficacy, outcome expectations, goal creation, and professional identity formation.

Educating for adaptive expertise: case examples along the medical education continuum.

Adaptive expertise represents the combination of both efficient problem-solving for clinical encounters with known solutions, as well as the ability to learn and innovate when faced with a novel challenge. Fostering adaptive expertise requires careful approaches to instructional design to emphasize deeper, more effortful learning. These teaching strategies are time-intensive, effortful, and challenging to implement in health professions education curricula. The authors are educators whose missions encompass the medical education continuum, from undergraduate through to organizational learning. Each has grappled with how to promote adaptive expertise development in their context. They describe themes drawn from educational experiences at these various learner levels to illustrate strategies that may be used to cultivate adaptive expertise.At Vanderbilt University School of Medicine, a restructuring of the medical school curriculum provided multiple opportunities to use specific curricular strategies to foster adaptive expertise development. The advantage for students in terms of future learning had to be rationalized against assessments that are more short-term in nature. In a consortium of emergency medicine residency programs, a diversity of instructional approaches was deployed to foster adaptive expertise within complex clinical learning environments. Here the value of adaptive expertise approaches must be balanced with the efficiency imperative in clinical care. At Mayo Clinic, an existing continuous professional development program was used to orient the entire organization towards an adaptive expertise mindset, with each individual making a contribution to the shift.The different contexts illustrate both the flexibility of the adaptive expertise conceptualization and the need to customize the educational approach to the developmental stage of the learner. In particular, an important benefit of teaching to adaptive expertise is the opportunity to influence individual professional identity formation to ensure that clinicians of the future value deeper, more effortful learning strategies throughout their careers.

Filling the Core EPA 10 assessment void: A framework for individual assessment of Core Entrustable professional activity 10 competencies in medical students.

Objectives: The goal of this study was to develop and evaluate a novel curriculum and assessment tool for Core Entrustable Professional Activity (EPA) 10 competencies and entrustment scoring in a cohort of medical students in their emergency medicine (EM) clerkship using a framework of individualized, ad hoc, formative assessment. Core EPA 10 is an observable workplace-based activity for graduating medical students to recognize a patient requiring urgent or emergent care and initiate evaluation and management. Methods: This is a prospective, pretest-posttest study of medical students during their EM clerkship. Using the Thomas and Kern framework, we created a curriculum of simulation cases about chest pain/cardiac arrest and respiratory distress, which included novel assessment checklists, and instructional videos about recognizing and managing emergencies. Students were individually pretested on EPA 10 competencies using the simulation cases. Two raters scored students using standardized checklists. Students then watched instructional videos, underwent a posttest with the simulation cases, and were scored again by the two raters using the checklists. Differences between pretest and posttest scores were analyzed using paired t-tests and Wilcoxon signed-rank tests. Results: Seventy-three out of 85 (86%) students completed the curriculum. Mean scores from pretest to final posttest in the chest pain/cardiac arrest and respiratory distress cases significantly improved from 14.8/19 (SD 1.91), to 17.1/19 (SD = 1.00), t(68) = 10.56, p < 0.001, and 8.5/13 (SD 1.79), to 11.1/13(SD 0.89), t(67) = 11.15, p < 0.001, respectively. The kappa coefficients were 0.909 (n = 2698, p < 0.001) and 0.931 (n = 1872, p < 0.001). Median modified Chen entrustment scores improved from 1b (i.e., "Watch me do this") to 2b (i.e., "I'll watch you") for the chest pain/cardiac arrest case (p < 0.001) and 1b/2a (i.e., "Watch me do this"/ "Let's do this together") to 3a (i.e. "You go ahead, and I'll double-check all of your findings") for the respiratory distress case (p < 0.001). Conclusion: A new directed curriculum of standardized simulation cases and asynchronous instructional videos improved medical student performance in EPA 10 competencies and entrustment scores. This study provides a curricular framework to support formative individualized assessments for EPA 10.